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ABSTRACT 

A  procedure  is  developed  which  can  be  used  to  obtain  the 

solution  of  a  two-sided  allocation  problem  with  payoff  of  the 

form  I  =  5Q  K(x,y«t)dt  if  K  is  concave  in  x(t),  i.e.  K   <  0, 
a  xx 

and  convex  in  y(t)  for  all  t  in  the  interval  [a,b]„   A 
second  degree  polynomial  example  is  explained  in  detail  to 
illustrate  the  procedure.   The  computer  program  and  a  sample 
output  for  this  example  constitute  the  Appendix.  Next  an 
exponential  search  problem  is  discussed.   Then  in  conclusion 
a  general  application  of  the  method  is  outlined. 
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1.   Introduction . 

The  purpose  of  this  thesis  is  to  investigate  a  method  for 
obtaining  the  optimum  solutions  of  two-sided  allocation  prob° 
lems.   A  two-sided  allocation  problem  is  one  in  which  there 
are  two  sides  allocating  resources  with  opposing  interests „ 
Generally  one  side  can  optimize  its  position  by  minimizing 
some  factor,  such  as  L  K  dt  where  each  side  has  some  control 
of  K,  which  the  opposing  side  would  like  to  maximize,  or  vice 
versa. 

The  problem  of  maximizing  (or  minimizing)  a  functional 
5a  K[y(t)]  dt  over  a  certain  class  of  functions  {y(t)]  has 
been  studied  by  use  of  various  methods.   Among  these  are  the 
use  of  Lagrange  multipliers[2,  9],  techniques  of  calculus  of 
variations[l,  8],  and  methods  of  control  theory[3]  such  as  the 
differential  methods  used  in  this  paper. 

There  appears  to  have  been  little  application  of  these 
methods  to  the  two-sided  allocation  problem  where  K  is  a 
function  of  two  functions,  x(t)  and  y(t).   Although  the  theory 
of  games  has  application  to  this  type  of  problem  if  K(x,y,t) 
is  a  real  valued  function  that  is  convex  in  y,  i.e.  K   >  0, 
and  concave  in  x[6],  it  does  not  provide  a  method  for  obtain- 
ing a  solution.   The  subscript  indicates  partial  differentia- 
tion with  respect  to  the  corresponding  variable. 

Until  the  last  five  years  there  did  not  exist  a  method 
which  could  be  used  to  obtain  the  solution  of  optimization 
problems  subject  to  constraints  on  resources.  However,  differ- 
ential  methods  such  as  those  used  by  Faulkner[3]  have  been 
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developed  recently  which  can  solve  such  problems „   A  method 
for  determining  solutions  by  differential  equations  using  an 
analog  computer  has  been  developed  by  Kose[4]u 

A  version  of  the  differential  methods  given  by  Faulkner 
[3]  will  be  used  in  this  thesis0   These  methods  not  only  seem 
simpler  to  grasp  and  apply  to  the  particular  functionals  con- 
sidered, but  they  provide  a  method  for  solving  either  maxi- 
mization, minimization,  or  minimization-maximization  (saddle 
value)  problems  with  a  speed  and  simplicity  that  none  of  the 
others  (with  the  possible  exception  of  Kose[4])  seem  to  have. 


2.  Basic  principles. 

Consider  a  functional  of  the  form 

(1)  I  =  5^  K  dt 

where:  K  =  K(x,y,t)  is  a  real  valued  function^  x  =  x(t)  is  a 
function  to  be  found  which  maximizes  (1)  subject  to 

(2)  x  >  0   and   ^  x  dt  =  1; 

■"  a 

and  y  =  y(t)  is  a  function  to  be  found  which  minimizes  (1) 
subject  to 

(3)  y  >  0   and   $*   y  dt  =  1. 

™  CI 

A  function  x,  or  y,  which  is  piecewise  continuous  in  [a,b] 
and  satisfies  (2),  or  (3),  will  be  called  admissible.   If  the 
total  resources  available  to  each  side  are  not  unity,  they 
can  easily  be  normalized  to  comply  with  (2)  and  (3),  making 
the  functions  x(t)  and  y(t)  density  functions  which  indicate 
relative  allocation  of  resources,, 

It  will  be  convenient  to  introduce  a  new  functional,  J. 
Let  H  =  K  +  Ax  +^y  where  ^  and^t  are  constants  (Lagrange 
multipliers)  to  be  found .   Let 

(4)  J  =  5«  H  dt. 

We  see  that  if  x  and  y  are  admissible  functions,  then  J  dif- 
fers from  I  by  the  number  A  +/<<> 

Now  if  y  were  a  given  function  we  could  get  a  maximum 
value  for  J, 

J(x0,y)  =  maximum  J(x,y) 

by  maximizing  the  Hamiltonian.  H,  subject  to  the  constraint 
x  >  0,  for  each  value  of  t  on  the  interval  [a,b];  however 
the  function  x(t)  might  not  be  admissible „  Also,  for  given 
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x(t)  we  could  get  a  minimum 

J(xsy0)  =  minimum  J(x,y)0 

It  should  be  pointed  out  that  the  function  x0  above  depends 
on  both  y(-t)  and  the  parameter  A,  and  y0  depends  upon  x(t) 
and  Mo      Observe  that  also 

(5)  J(x,y0)  <  J(x0,y0)  <  J(x0,y) 

since  by   the  way  it  was  obtained  x0  maximizes  J(x,y)    for   any 
given  y,    even  y0 ,    and  y0  minimizes  J(x,y)    for   any   given  x, 
even  x0 , 

If  the  functions  x0   and  y0   are   admissible ,   we  will  call 
them  the  min~max  strategies   (x*,y*)    and  we  will  call  J(x*,y*) 
the  min-max  solution.      Hence,    to   solve   a  min-max  problem  we 
want   to  determine,    for   some  A   sx&M  initially  unknown, 
J(x0,y0)    subject   to   the  restrictions   (2)    and   (3)    on  x(t)    and 
y(t)„      Any  pair  of  admissible  functions   (x*,y*)    which  fur- 
nishes   the  min-max  solution  of   (4)    will   also   provide   the  min- 
max  solution  of   (1)    since 

(6)  J  =   5^  H  dt  =   5^(R  +  Ax  +/<y)dt   =  I   +   (A  +/«). 
Let  us   assume   that  K  has  continuous   second  derivatives,. 

Then  notice   that   an  absolute  maximum   (or  minimum)    which  is 
not   a   stationary  point  can  only  occur   at  x  =  0   (or  y  =  0)    for 
admissible  functions 9      If  an   absolute  maximum  occurred  for 
x  =  Xi   >  0,    then  any  laiger  value  of  x,    say  x  =  x±  +  €,   would 
yield   a  larger  value  of  H  since  H     >  0   at  xl8      A  similar   argu* 

■ft 

ment  applies  to  minimization  over  y0   Therefore  for  a  min-max 
solution  to  exist,  the  functional  K(x,y,t)  must  not  be  mono- 
tone increasing  in  x  or  monotone  decreasing  in  yu 

4, 


If  the  second  derivatives  of  K  are  continuous,  then  the 
following  conditions  exist .   To  get  maximum  H  at  a  point  on 
the  interval  [a,b],  either  there  is  a  relative  maximum  for 
which 

(7)  Hx  =  Kx  +  *  =  0 

or  else,  if  the  maximum  occurs  on  the  boundary  then 

(8)  x  =  0, 

Similarly  for  minimum  H,  either  there  is  a  relative  minimum 

y 

for  which 

(9)  Hy  -  Ky  +/t  =  0 

or  else,  if  the  minimum  occurs  en  the  boundary  then 

(10)  y  =  0. 

An  indication  of  a  boundary   situation  will  be  negative  values 
of  x  or  y   as   solutions  of  equations   (7)    and    (9). 

A  min-max  problem  may   also  be   called   a   saddle  value 
problem  if  the  integrand  is   strictly  concave  in  x  (K       <  0) 
and    strictly  convex  in  y   (K       >  0)    on  the  interval   [a,b]0 
According   to  Kuhn   and  Tucker[5]    the  conditions 

Hx(x0?y0)    <  0,  Hx(x0,y0)x0   =0,  x0   >  0 


(11) 


Hy(x0,y0)    I  0,  Hy(x0,y0)y0   =0,  y0   >  0 


are  necessary  in  order  that  (x0,y0)  provide  a  solution  for 
the  saddle  value  problem,  which  neatly  summarizes  the  previous 
two  paragraphs . 

If  the  function  K  is  not  concave  in  x  and  convex  in  y 
the  possibility  of  multiple  solutions  of  (7)  and  (9)  arises. 
In  this  case  the  difficulty  of  computation  increases  consider- 


ably0   Each  possible  pair  of  roots  (x,y)  must  be  checked  to 

determine  the  x  which  maximizes  H  and  the  y  which  minimizes 

H0   This  operation  must  be  repeated  for  each  value  of  the 

parameter  t  on  the  interval  [a,b]„ 

Only  the  simple  case  where  K(x,y,t)  is  strictly  concave 

in  x,  K   <  0,  and  strictly  convex  in  y,  K  r  >  0,  over  the 
xx  yy 

domain  [a,b]  of  the  parameter  t  will  be  considered  further 0 
Differentials  will  be  defined  and  a  Newton-Raphson  iteration 
set  up  to  determine  the  desired  solution,, 

While  we  had  no  trouble  with  convergence,  this  is  often 
a  problem  when  using  a  Newton-Raphson  iteration  procedure^, 


30   Computational  procedure. 

In  this  section  we  will  set  up  a  Newton -Raphson  iteration 
for  the  solution.   To  start,  let  us  guess  values  for  the  La- 
grange multipliers  A  and  z*  and  compute  a  trial  solution  for 
x(t)  and  y(t)  using  equations  (7),  (8),  (9)  and  (10) .  Usually 
it  will  not  be  an  admissible  solution  since 

5^  x  dt  =  X  /   1    and    5^  y  dt  =  Y  /   1, 

But  we  shall  see  that  if  the  solution  thus  found  is,  by  rare 
good  luck,  admissible,  then  we  have  the  min-max  solution. 
This  follows  directly  from  (5)  since  any  trial  solution  is 
(xosvo)  f°r  the  particular  values  of  A  and^  chosen ^ 

Let  us  now  set  up  a  routine  for  correcting  the  values  of 
(X,Y)  obtaining  a  sequence  approaching  (1,1),   Suppose  we  con- 
sider the  given  trial  solution  and  neighboring  values  of  A  and 
^    say  /\  +  dA  and^  +  d/(.   Every  optimal  solution  must  satisfy 
Hx(x0,y0)x0  =  0  and  H  (x0,y0)yo  =  0  from  equations  (11),   Gen- 
erally only  one  of  the  terms  in  each  product  is  zero  at  any 
point  on  the  interval  [a,b].   If  these  zero  terms  are  con- 
strained to  remain  zero  as  we  change  x,  y,  A  and ^  by  small 
amounts  <5x,  oy,   dA  and  d/*,  then  x  and  y  must  always  maximize 
and  minimize,  respectively,  H  since  the  requirements  (11)  re- 
main satisfied.  We  must  change  x,  y,  A  and^/<,  in  such  a  way, 
satisfying  the  above,  that  the  values  X  and  Y  approach  unity. 
In  order  to  calculate 

dX  =  5^  cSx  dt     and     dY  =  $b  6y   dt 
a  a 

let  us  divide  the  interval  [a,b]  into  four  subsets  of  inter- 
vals T0,  Tx ,  T2  and  T3,   On  the  intervals  in  T0  the  min-max 
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values  of  x  and  y  are  obtained  from  (7)  and  (9),  i.e.  x  >  0 
and  y  >  0;  on  those  in  Tj.  we  use  (7)  and  (10),  i.e.  x  >  0  and 
y  =  0;  on  those  in  T2  we  use  (8)  and  (9),  i.e.  x  =  0  and 
y  >  0;  and  on  those  in  T3  we  use  (8)  and  (10),  i.e.  x  =  0 
and  y  =  0o   The  resulting  variations  <5x(t)  and  Sy(t)   will  be 
given  in  the  intervals  of  T0  by 

0  =  6u     =  H   Sx   +  H   cfy  +  dA 

(12)  x    xx       xy 

0  =  6Hy   =  Hyx  6x   +  Hyy  St  *   d//. 

In  the  intervals  of  Tx   they  are  given  by 

0  =  6E     =  H  Sx  +  dA 

(13)  x    xx 

0  =  Sy 

since  y  =  0  on  these  intervals .   In  the  intervals  of  T2  they 

are  given  by 

0  =  Sx 

(14) 

0  =  6Ky   =  Hyy  cfy  +  d/t 

since  x  =  0.   Finally  in  the  intervals  of  T3 

o  =        6x 

(15)  . 

0  =  dy* 

Hence  we  have  equations  of  the  form 

bn(t)  Sx   +  b12(t)  cfy  +  dA  =  0 
(16) 

b2i(t)  6x  +   b22(t)  Oy   +  d/<=  0 

which  can  be   solved   for 

cfx(t)    =   axl(t)    dA  +   a12(t)    d/d 
(17) 

cTy(t)    =  a21(t)    dA  +   a22(t)   tyu 

where  the  a. ,'s  are  obtained  from  (12),  (13),  (14)  or  (15), 

depending  on  the  interval. 

We  are  now  ready  to  calculate  the  total  effects,  dX  and 
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dY,  of  the  small  changes  (fx(t)    and  <5y(t)u   Integration  over 
the  entire  interval  [a,b],  consisting  of  the  four  subsets  T0, 
Tl5  T2  and  T3,  yields 

dX  =  A1X  dA  +  A12  dyU 

dY  =  A21  d/\  +  A22  d^ 


(18) 
where 


dX  =  ^  cfx(t)  dt,         dY  =  5^  cfy(t)  dt, 

Aij  =  *a  «l.J<*)  dt* 

Now  let  us  treat  the  differentials  in  (18)  as  differences  to 

get 

An  A^\  +  A12  LM   =  AX  -  1  -  X 
(19) 

A21  AA  +  A22  A/<  =  AY  =  1  -  Y„ 

These  equations  (19)  can  now  be  solved  for  AA  and  A/t;  thus  we 
determine  new  values  of  A  and ^u  which  tend  to  drive  the  solu- 
tion toward  admissibility0 

Let  us  repeat  this.   We  compute  another  trial  solution 
using  the  new  values  of  A  and^.  Repeat  this  sequence  until 
the  "errors"  dX  and  dY  become  sufficiently  small  and  the 
solution  is  admissible,  within  the  required  accuracy. 

It  is  convenient  tc  define  an  error  term  which  can  be 
used  tc  check  the  convergence  toward  admissibility.   Let  the 
error,  E,  be  defined  as 

(20)      E  =  (1  -  X)2  +  (1  -  Y)2  =  AX2  +  AY2, 
as  the  error  goes  to  zero  the  solutions  approach  admissibility 
since  both  X  and  Y  must  be  approaching  unity  and  the  differ- 
ences, AX  and  AY,  must  approach  zero, 

an   important  feature  of  this  differential  method  is  that 


each  solution  is  an  optimal  (maximizing  and  minimizing)  solu- 
tion for  the  particular  values  of  /\  and  yU  ,  or  endpoints  X  and 
Y?  considered 0   The  successive  iterations  drive  x0  and  y0  to 
admissibility ^  thus  yielding  the  min-max  (or  saddle  value) 
solution  which  satisfies  the  given  constraints  (2)  and  (3), 
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4a   Second  degree  polynomial  examples. 

In  order  to  test  the  method  a  computer  program  was 
written,  using  FORTRAN  language,  and  run  on  a  CDC  1604  com- 
puter .   The  form  of  this  program  and  a  sample  solution,  which 
will  be  explained  in  detail,  appear  in  the  Appendix.   The 
program  was  set  up  first  for  an  integrand  of  the  type 
(21)      K(x,y,t)  =  (y  +  At  +  B)2  +  xyt  -  (x  +  Ct  +  D)2. 
The  parameters  A,  B,  C  and  D  were  assigned  various  sets  of 
integer  values  to  test  the  general  applicability  of  the 
method.   In  every  case  the  interval  [a,b]  was  chosen  to  be 
[0,1], 

The  choice  of  initial  values  of  the  Lagrange  multipliers, 
A  and^,  is  at  times  a  minor  problem  in  getting  started.   If 
the  initial  values  yield  only  negative  values  of  x(t)  and  y(t) 
over  the  interval  [a,b],  as  determined  by  equations 
(7)       h  =  K  +  A  =  0    and 
(9)       Hy  =  Ky  +A  =  0, 

then  the  procedure  has  no  way  of  determining  appropriate 
changes,  AA  and  A/<,  of  the  Lagrange  multipliers  for  a  new 
iteration  since  each  of  the  A . . ' s  in  equation 

dX  =  Aal  dA  +  A12  6M 

(18) 

dY  =  A21  dA  +  A22  d/< 

will  be  zero.   The  solution  of  equations  (7)  and  (9)  at  any 

point  on  the  interval  [a,b]  with  the  requirement  that  both  x 

and  y  be  positive  at  that  point  should  indicate  appropriate 

initial  values  of  A  and  ^   such  that  convergence  and  a  solution 

will  occur. 
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Now  let  us   go   through  the  method   in  detail   for   a   specific 

(22)  K(x,y,t)    =   (y  +   2t)2  +   xyt   -    (x  +   3t)23 
The  Hamiltonian,   H,    is 

(23)  H  =   (y  +   2t)2  +   xyt   -    (x  +   3t)2  +  "Ax  + /ty 
and   its   second   partial  derivatives   are 

H       =     t  =  K 

xy  xy 

(24)  Hxx  =   -2  =  Kxx  <  0 

Hyy  =    2  =  Kyy>0- 

The  first  partial  derivatives  of  H  are 

H     =   ~2x  +   ty   -   6t  +   A 
(2b)  x 

H     =      tx  +   2y  +  4t  +  yUo 

We   can   see   that  K   is   strictly  concave  in  x  and   strictly  convex 

in  y   from   (24).      Upon   setting  H     =  H     =  0   we   can   solve   for 

x   y 

x(t) 
(26) 

t"  +  4 

Recall  that  the  maximizing  function  x  =  x0  and  the  minimizing 

function  y  =  y0  satisfy 

x0  =  x(t)    if  x(t)  >  0 
=  0       if  x(t)  <  0 

y0  =  y(t)    if  y(t)  >  0 
=  0       if  yCt)  <  0 

when  x(t)    and  y(t)    satisfy  equations   (26) . 

To  determine   appropriate  initial  values  of  ~X  and^  in 

this   problem 9    evaluate   (26)    at   a  particular  value  of   t,    say 

t   =  Oo      Then  x(0)    =  C>5/\  and  y(0)    =  =C )„^<,    and   any  values  of 
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y(t)    =  £t^8jp  J^ 


(27) 


"A  >  0  and  /a  <  0  are  satisfactory  for  an  initial  guess.   If  we 
take  /\  =  10  and  /a   =  -10,  then  x(0)  =5  and  y(C)  =  5. 

Let  us  arbitrarily  divide  the  interval  [0,l]  into  100 
equal  parts  of  length  0.01  and  calculate  x(t)  and  y(t)  by  (26) 
for  t  =  0,  0„01,  0o02s  o  o  *  9   0.99,  1.00.   Meanwhile  we 
should  determine  which  of  the  four  subsets  of  intervals,  T0 , 
Tj_ ,  T2  or  T3,  we  are  in  for  each  value  of  t  in  order  to  cal- 
culate the  a . . ' s  which  are  necessary  for  the  determination  of 
j-  j 

AA  and  A>t  if  the  solution  is  not  admissible0   The  a . . v s  are 
given:   in  T0  (x  >  0,  y  >  0)  by 

KK     K_  K  K    —  K 

xx^  yy    xy  xx  yy    xy 

K  -  Kxx 

a21(t)  =  g  ?    a22("t)  =  2  ' 

KK=K  K  K    •=  K 

xx  yy    xy  xx  yy    xy 

in  TA  (x  >  0,  y  =  0)  by 

a1A(  t)=  |r™=  , 

(28)  XX 

ais(^)  =  a2l(^)  ~  a22(^)  =  0$ 

in  T2  (x  =  0,  y  >  0)  by 

aXi(t)  =  a12(t)  =  a21(t)  =  0, 

(29)  _^ 

a22("t)  ~  K     5 

yy 

and  in  T3  (x  =  0,  y  =  0)  by 

(30)  aa(t)  =  a12(t)  =  a21(t)  =  a22(t)  =  0. 

For  this  particular  example  we  find  that  T0  =  [o,  0.82],  Tx 
is  empty,  T2  =  (0o82,  1,0]  and  T3  is  empty. 

Let  us  integrate  x0(t)  and  y0(t)  using  a  trapezoidal  or, 
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if  more  accuracy  is  desired,  Runge-Kutta  method  to  determine 
if  they  are  admissible,  i.e.  they  integrate  to  unity.   They 
are  not  admissible  since 

5^  x0  dt  =  4.1225- ••  and   5*  y0  dt  =  3.0644- ••. 

For  each  value  of  t  on  [0,1],  a  change  in  x,  y,  A  and^  ac- 
cording to 

Sx   =  £.n  dA  +  a12  d// 
(17) 

Ov   =  a21  dA  +  a22  d/< 

will  retain  the  maximizing  and  minimizing  properties  of  x0and 

y0.   The  total  changes  over  the  interval  [0,1]  are 

dX  =  An  dA  +  A12  d/t 
dY  =   A21   dA   +   A22   d/i 


(18) 
where 


dX  =  $J  6x   dt  ,       dY  =  sl  <$Y   dt  , 

Aij  =  *0  aij  dt' 
For  first  order  approximations  treat  the  differentials  as 
differences  and  set 

AX  =  1  -  X  =  An  AA  +  A12  ts/*   =  -3.1225* •• 

AY   =   1    -   Y   =   A21   AA   +    A22  A//  =    -2.0644- ••. 
Solve   for 

AA  =   -5.3532- • • 

A/t  =      5.7408» • • . 
Repeat   the  calculations  of  x  and  y  by   (26)    v/ith 

A   =  4. 6468 • • • 

/A.   =-4.2592»  •  •  . 
Continue  the  routine  and  repeat  until  AX  and  AY  are  acceptably 
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small. 

Other  polynomials  solved  by  this  procedure  were: 

(31)  K(x,y,t)  =  [1  +  (t  -  .5)2]y2  +  xyt  -  x2, 

(32)  K(x,y,t)  =  y2sin(t)  -  xycos(t)  -  x2. 

The  last  one  was  solved  for  the  interval  [0,1]  and  also  the 
interval  [0,tt]o   Care  must  be  taken  to  ensure  that  the  inte- 
grand, K,  maintains  its  strictly  concave,  strictly  convex 
properties  over  the  entire  interval.   The  interval  [0?2jr] 
cannot  be  used  for  (32)  because  K   =  2sin(t)?  which  becomes 
negative  on  the  interval  [tt,2tt]. 
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5.   Exponential  search  example. 

The  particular  functional  which  kindled  interest  in  the 
two-sided  allocation  problem  was  the  integral 

Sl   x[l  -  e-«*]  dt 

which  represents  the  probability  of  detecting  an  object  dis- 
tributed as  x  =  x(t)  over  the  interval  [a?b]  by  use  of  a 
search  effort  distributed  as  y  =  y(t)  over  the  same  interval 
if  the  law  of  detection  has  the  exponential-saturation  form 
as  in  random  search[79  9]e   The  function  g  =  g(t)  is  a  measure 
of  the  ease  with  which  a  unit  of  search  conducted  near  t 
detects  a  target  there  and  is  considered  known .  For  "stand- 
ard" conditions ,  g  may  be  considered  unity „ 

To  maximize  this  integral  with  respect  to  y  it  is  neces- 
sary to  minimize  over  y 

(33)      I  =  5^  x  e°gy  dt0 

This  problem  was  posed  and  a  method  of  solution  given  in 
Search  and  Screening ,  0oEoGo  Report  No0  56[9]  and  in  a  paper 
written  by  Bernard  0o  Koopman[7]  who  edited  the  above  report 0 
However,  the  maximization  over  x  of 

min  5^  x  e"gy  dt 
y   a 

was  not  considered o 

Notice  that  this  problem  does  not  meet  the  requirement 
of  strict  concavity  in  x  since  K   =  0o  However  the  differ- 
ential  method  produced  a  min~max  solution  and  min-max  strate- 
gies with  no  difficulty.  Minor  modifications  to  the  FORTRAN 
program  listed  in  the  Appendix  were  made  to  fit  it  to  this 
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problem o   The  function  g  was  assumed  to  be  of  the  form 

g  =  A  +  Bt  +  Ct2  +  Dt3 
and  required  to  be  strictly  greater  than  aero.   The  parameter 
A  was  given  the  values  0„01,  0»1,  1,  3  and  the  other  parame- 
ters were  either  all  zero  or  else  one  was  set  equal  to  ±089 
until  17  different  problems  were  solved .   The  smallest  and 
largest  values  of  g  were  0o01  and  3o0o   The  number  of  itera- 
tions  required  to  drive  the  error  less  than  10"   was  never 
more  than  sixQ   The  program  compiled  in  47  seconds  and  required 
about  10  seconds  to  complete  a  single  solution 0 

It  became  apparent  that  this  particular  problem  could  be 
solved  more  easily  than  by  the  differential  method  used0   Con- 
sider the  Hamiltonian 

H  =  x  e°gy  +  ^x  +/<yD 
To  minimize  H  over  y(t)  we  solve 

H  =  -gx  e=gy  +  it  =  Oc 

y 

We  may  solve  for  y,  obtaining 

y(t)  =  -J-  log.-**-     if  g(t)x(t)  >// 
(34)  g     e  /c^- 

=  0  if  g(t)x(t)  </{0 

This  is  the  solution  obtained  by  Koopman[7,  9]  for  any  fixed 
function  x(t)0   We  must  also  maximize  H  over  x(t)  and  hence 
we  have  a  second  equation 

H  =  e°gy  +  A  =  Oo 
We  must  solve  these  simultaneously  for  x  and  y0   We  require 

then 

1 
y(t)  =  ~rrr  log 


t)  ^&e   ~A 
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or  g(t)y(t)  =  constanto  From  (34)  we  see  that  gx  must  also 
be  constant  if  gy  is  to  be  constanto  Due  to  the  requirements 
for  admissibility  it  follows  that 

x(t)  =  y(t)  =  ^y 

where  T  is   a  constant   to  be  determined 0      If  the  constant  T  is 
assigned   any  reasonable  positive  number,   one  iteration  will 
be   sufficient   to  determine   the  min-max  strategies   (x%y*) 
since   the  initial   solution   (x09y0)    can  be  made   admissible  by 
normalizing  it0      For   example  if 

5^  x0   dt   =  X  -   J*  y0   dt 

then 

jt>  xaiil  dt  =  i  =  $*?  y^r^  dt 

a       a  a       a 


and 


x*(t)  =  ^4^  =  y*(t)0 


All   that  remains  is   to   show  that   the   solution   attained 
is   truly  a  min°max  solution  in   that  x*   and  y*   are  min-max 
strategies o      Consider   the   payoff 

IU%y*)    =   $a  x*e-gy*dt  =   5a  ~A  x*dt  =   ~*  ■ 
Observe   that  if  gy*  remains  constant  over   the  interval   [a,b] 
then  for   all   admissible  x  we  have 

Kx,y*)    =   5a~;U(t)   dt  =  -A  =  I(x*,y*)„ 

Since  the  integrand,  K,  is  strictly  convex  in  y  (K   >  0) ,  it 
is  obvious  that  for  all  admissible  y(t) 
I(x*,y*)  <  I(x%y)0 
If  x  =  Xj.(t)  f   x*(t),  then  there  exists  a  yi*(t)  such 
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that 

and  x  ^   x*(t)  obviously  does  not  maximize  I0   In  conclusion 

I(xlsy/)  <  I(Xi,y*)  =  I(x*,y*)  <  I(x*,y) 

and  (x*,y*)  is  a  min-max  strategyD 

As  a  rough  check  to  ensure  that  x*  was  a  maximizing  stra< 

tegy,  equation  (34)  was  used  to  calculate  the  minimizing  stra- 
ti 
tegies  y  for  predetermined  non-optimal  strategies 

x(t)  =  1, 

x(t)  =  0o05  +  1.9t, 

x(t)  =  1D95  -  1.9t, 
letting  g(t)  vary  as  in  the  min-max  calculations  previously „ 
In  every  case  the  min-max  solution  payoff  was  greater  than 
the  minimizing  solution  payoff  when  x  was  fixed  not  equal  to 
x*(t). 
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6.   Conclusions 0 

The  differential  methods  discussed  in  this  thesis  can  be 

used  to  determine 

b 
max  min  5a  K(x,y,t)  dt 

subject  to 

x  >  0,    5^  x  dt  =  X 

(35)  h 

y  >  0,    §1   y  dt  =  Y 

where  X  and  Y  are  given  numbers  and  the  integrand  has  certain 
properties o   It  must  not  be  monotone  increasing  in  x  or  mono- 
tone decreasing  in  y?  for  x  and  y  large,  over  the  interval 
[a,b].   The  integrand,  K,  is  assumed  to  be  finite  and  real 
valued  although  it  need  not  be  continuous  as  long  as  the 
regions  of  discontinuity  are  known .  Determination  of  maxima 
and  minima  is  accomplished  by  comparison  of  the  value  of  K  at 
stationary  extrema  with  its  value  at  the  discontinuities0 

This  thesis  specifically  covers  the  cases  when  K  is  twice 
dif ferentiable,  strictly  concave  in  x  (K   <  0),  and  strictly 
convex  in  y  (X   >  0)  for  non-negative  piecewise  continuous 
x  and  y  over  the  domain  [a,b]  of  the  parameter  t.   For  this 
type  of  function,  K,  a  min°max  solution,  I(x*(t),  y*(t)),  and 
a  min-max  strategy  (x*(t),  y*(t))  can  be  determined  which 
satisfy  the  constraints  (35), 
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APPENDIX 
First  the  symbols  and  terms  used  in  the  FORTRAN  program 
will  be  correlated  with  those  introduced  in  the  text  of  the 
thesis;  then  a  brief  explanation  of  the  program,  the  program 
itself,  and  a  sample  output  will  follow0 


FORTRAN 
symbols 


XM 


Text 
t 


YM 

Yo 

FUNF 

I 

FXYF 

K 
xy 

FXXF 

Kxx 

FYYF 

K 
yy 

A(l,l) 

an(t) 

AT0T(1,2) 

£a12  dt 

U 

A 

V 

/A 

XTOT 

X 

YTOT 

Y 

T(I) 

t 

X 

x(t) 

Y 

y(t) 

DX 

6x 

DY 

6y 

DU 

dA 

Explanation 

the  independent  variable  defined  on 
the  interval  [0,1] 

that  x  which  maximizes  H  where 
H  =  K  +  Ax  +  yUy 

that  y  which  minimizes  H 

1=5  K  dt  where  K  =  K(x9y?t) 

92K/9x6y 

a2K/ax2 
82K/ay2 

from  equation  (17) 

from  equation  (18) 

Lagrange  multiplier 

Lagrange  multiplier 

5oxo  dt 

5*yo  dt 

a  particular  value  of   t  on   [0,l] 

a   solution  of   equation   (26) 

a   solution  of  equation   (26) 

a   small  change  of  x0(t) 

a  small  change  of  yo(t) 

a   small  change  of  A 
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symbols 

Text 

Explanation 

DV 

(lyU 

a  small  change  of^ 

DIFFX 

dX 

1  -  5jx0  dt 

DIFFY 

dY 

1  -  S*Vo   dt 

PAYOFF 

I(x,y) 

SXK   dt 

Jo 

Items  set  off  by  a  brace  of  CCCCCC's  will  generally 
change  when  the  integrand,  K,  is  changed . 

After  the  maximum  number  of  iterations ,  division  of  the 
interval  [a,b]?  acceptable  error  and  initial  Lagrange  multi- 
plier values  are  determined,  we  commence  the  iterations e   The 
interval  [a,b]  has  been  chosen  to  be  [0,1].   The  variable  T(I) 
is  defined  in  such  a  way  that  it  takes  on  values  from  zero  to 
one  as  the  index,  I,  goes  from  1  to  101 .   Srfe  now  solve  the 
first  derivative  equations  (26)  for  X  and  Y,  and  determine 
which  set  of  subintervals,  T3,  T2 ,  1X   or  T0 ,  we  are  in  so  that 
XM,  YM,  A(l,l),  A(l,2),  A(2,l)  and  A(2,2)  may  be  determined. 

Since  we  are  using  a  trapezoidal  integration  routine,  we 
sum  XM,  YM,  A(l,l),  A(l,2),  A(2,l)  and  A(2,2)  as  we  calculate 
them  and  then  multiply  each  total  by  the  width  of  one  inter- 
val, At,  to  determine  the  integrals.   After  the  error  is 
determined,  pertinent  values  are  printed  and  then  if  the  solu- 
tion is  not  admissible,  within  the  acceptable  error,  changes 
of  the  Lagrange  multipliers  are  computed  using  the  subroutine 
at  the  end  of  the  programc   The  iterations  are  repeated  until 
the  error  is  acceptable  and  the  solution  XM,  YM  is  admissible . 
The  payoff  is  now  calculated  using  again  the  trapezoidal 
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integration  method .   The  min-max  solution  (PAYOFF)  and  min- 
max  strategies  (XM,  YM)  are  now  printed „ 

Statements  150,  140  and  135  are  used  only  if  poor  ini- 
tial values  of  the  Lagrange  multipliers  are  chosen  such  that 
the  matrix  ATOT  is  singular  (i„e0  its  determinant  is  zero). 
The  printout  is  for  information  only,, 

The  numbers  at  the  end  of  the  program  are  sample  values 
of  AA,  Bj  C  and  D  to  be  read  into  the  program  as  datac 
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PROGRAM  MINMAX 

DIMENSION  T(900),  XM(900),  YM( 900) ,  ERROR! 50 ) , 
1      A(2,2),  ATOT(2,2) 
C 

C      INSERT  THE  FUNCTION  TO  BE  INTEGRATED  AND  ITS 
C      SECOND  PARTIAL  DERIVATIVES 
CC 

CCCC 
CCCCCC 

FUNF(X,Y,T)  =  ( Y+AA«T+B)«*2+X*Y*T-(X+C»T+D)»»2 

FXYF(X,Y,T)  =  T 

FXXF(X,Y,T)  =  -2. 

FYYF(X,Y,T)  =  2. 
CCCCCC 
CCCC 
CC 

C      MAXIMUM  NUMBER  OF  ITERATIONS  =  NR.  ,MUST  AGREE  WITH 
C      ARRAY  SIZE  OF  ERROR 

NR  =  50 
C 

C      NUMBER  OF  INTERVALS  OVER  WHICH  TO  EVALUATE 
C      AND  INTEGRATE 

NIPLUS1  =  101 
C  f 

C      EPSILON  IS  THE  ACCEPTABLE  ERROR  ', 

EPSILON  =  . 1E-15 
C 

WRITE  OUTPUT  TAPE  6,  200 
200  F0RMATMH1,  ////////3lX,  18HS0LUTI0N  OF  MINMAX////) 

CALL  TIME(6) 
C 

CC 

CCCC 
CCCCCC 

2  READ  INPUT  TAPE  5,  8,AA,  B,  C,  D 
8  FORMAT(UF10.5) 

WRITE  OUTPUT  TAPE  6,  210,  AA,  B,  C,  D 
210  FORMAT( 16HK(X,Y,T)  =  (Y  +  ,F8.5,5H*T  ♦  ,F8.5, 

1  19H)*»2  +  X»Y»T  -  (X  +,F8.5,5H»T  +  ,F8.5, 

2  UH)»*2///) 
CCCCCC 

CCCC 
CC 

WRITE  OUTPUT  TAPE  6,  220 
220  FORMAT (3HRUN, 10X , 1 HU, 1 6X , 1HV , 15X,UHXT0T, 13X,UHYT0T, 
1        14X,5HERR0R//) 
C 

c  ,  . .  •• 

C      SET  THE  INITIAL  VALUES  OF  THE  LAGRANGE  MULTIPLIERS 
C 


CC 

CCCC 

CCCCCC 

'u  = 

V  = 

10. 
-10. 

CCCCCC 

CCCC 

CC 

c 

FNI 

=  NIPLl 

-  1 

c 

c 

COMM 

ITERAT] 

c 

DO 

100   L 

=  If 

NR 

XTOT  =  0. 

YTOT  =  0. 

DO  5   M  »  1,2 

DO  5  N  =  1,2 
5  ATOT(M,N).  =0. 
C 

C      COMMENCE  CALCULATIONS  OVER  THE  INTERVAL  (0,1) 
C 
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DO  99  I  =  1 ,  NIPLUS1 

FI  =  I  -  1 

T(I )  =  FI/FNI 
C 

C      SOLVE  FIRST  DERIVATIVE  EQUATIONS  FOR  X,Y 
CC 

CCCC 
CCCCCC 

DENOM  =  T(  I  )«»2  +  U. 

Y  =  (T( I)*(2.*C*T( I )  -  U.*AA  +  2.*D  -  U)  -  U.»B 
1      -  2.«V)/DENOM 

X  =  (-T( I )»(2.*AA»T( I )  +  2.*B  +  U.«C  *  V)  -  U.»D 
1       +  2.*U)/DENOM 
CCCCCC 
CCCC 
CC 
C 

IF  (X)  10,20,20 
10  IF  (Y)  15,  25,  25 
20  IF  (Y)  35,  1*5,  45 
C 

C      BOTH  X  AND  Y  NEGATIVE 
C 

15  XM( I)  =  0. 

YM(  I  )  =  0. 

A(l ,1 )  =  0. 

A( 1 ,2)  =  0. 

A(2il )  =  0. 

A (2, 2)  =  0. 

GO  TO  50 
C 

C      X  NEGATIVE  AND  Y  NON-NEGATIVE 
C 

25  XM( I )  =  0. 

YM( I )  =  Y 

A(l ,1 )  =  0. 

A(l ,2)  =  0, 

A(2,  1  )  =  0. 

A(2,2)  =  -1 ./FYYF(XM(  I ),  YM(I),  TC  II  1 

GO  TO  50 
C 

C      X  NON-NEGATIVE  AND  Y  NEGATIVE 
C 

35  XM(  I  )  =  X 

YM( I )  =  0. 

A(l,l)  =  -l./FXXF(XM( I ),  YM(I),  T(  I)  )  ' 

AM  ,2)=  0. 

A(2,  1  )  =  0. 

A(2,2)  =  0. 

GO  TO  50 
C 

C      BOTH  X  AND  Y  POSITIVE 
C 

45  XM(  I)  =  X 

YMU)  =  Y 

DET  =  FXXF(XM( I) ,YM(I ) ,T(  I)  )*FYYF(XM ( I),YM{ I),T(I) ) 
1      -FXYF(XMd),  YM(D,  T(I))*»2 

A(l,l)  =  -FYYFUM(I),  YM(  I  )  ,  T(  I  ))/DET 

A(l,2)  =   FXYF(XMU),  YM  (  I  )  ,  T(I))/DET 

A(2,l  )  =  All, 2) 

A(2,2)  =  -FXXF(XM(I),  YM(I),  T(I))/OET 
C 
C 

C      DX  =  A{1 , 1 )»DU  +  A{ 1,2)*DV 
C      DY  =  A(2,1)«DU  +  A(2,2)»DV 
C 
C 
C      TRAPEZOIDAL  INTEGRATION  ROUTINE 


C 


50    IF(I-1)52,52.5U 

52    XTOT  =  XTOT  +  XM(  I)/2.  t 

YTOT=YTOT+YM( I)/2. 

''      '   ■ '    . 

Ct\J  • 


DO  53  M=l  ,2 

DO  53  N=l ,2  * 

53  ATOT(M,N)=ATOT(M,N)+A(M,N)/2. 
GO  TO  99 

54  IF( I-NIPLUS1 )55,52,52 

55  XTOT=XTOT+XM(  I  ) 
YTOT  =  YTOT  +  YM(  I) 
DO  56  M=l  ,2 

DO  56  N  =  1,2 

56  ATOT(M,N)=ATOT(M,N)+A(M,N) 
GO  TO  99 

99  CONTINUE 

XTOT  =  XTOT/FNI 

YTOT  =  YTOT/FNI 

DO  60  M  =  1,2 

DO  60   N=  1,2 
60  ATOT(M,N)  =  ATOT ( M, N) /FNI 
C 

c 

C      DETERMINE  ERROR 
C 

DIFFX  =  1.  -  XTOT  ;• 

DIFFY  =  1 .  -  YTOT  '  , 

ERROR(L)  =  DIFFX»«2  +  DIFFY*»2 

WRITE  OUTPUT  TAPE  6,  230 ,L.U,V, XTOT.  YTOT , ERROR ( L ) 
230  F0RMAT(I2,3XTF1U.8,3X,F1U.6,5X,F12.8,5X,F12.8,5X, 
1        E1U.8) 
IF(ERROR(L)  -  EPSILON)  105,  95,  95 
C 

C      CALL  SUBROUTINE  TO  SOLVE  MATRIX  FOR  DU  AND  DV 
C 

95  CALL  SOLVE( ATOT( T,l ), ATOT( 1,2),AT0T(  2, 1 ) , ATOTt 2 ,2 ) ,  » 
1  DIFFX,  DIFFY,  DU,  DV,  INO) 

GO  10  (97,150), IND 
97  U  =  U  +  DU 
100  V  =  V  ♦  DV 
C 

C      END  OF  A  RUN 

C      REPEAT  CALCULATIONS  USING  THE  NEW  VALUES  OF  U  AND  V 
C 
C 

C      BEST  U,  V,  XM(I),  YM(I)  ARE  NOW  STORED  FOR  EACH  T { I ) 
C      INTEGRATE  FUNF(XMU),  YM  (  I  )  ,  T(I)) 
C 

105  PAYOFF=0. 

DO  70  I=1,NIPLUS1 
IF( 1-1)62, 62, 6U 
62  PAYOFF  =  PAYOFF  +  FUNFUM(I),  YM(I),  T(I))/2. 

GO  TO  70 
6U  IF(  I-NIPLUS1 )65,62,62 

65  PAYOFF  =  PAYOFF  +  FUNF(XMd),  YM(I),  T(I)) 
70  CONTINUE 

PAY0FF=PAYOFF/FNI 
C 

C      END  OF  COMPUTATION 
C 

WRITE  OUTPUT  TAPE  6, 110, PAYOFF 
110  F0RMAT(//9HPAY0FF  =  ,E14.8//) 

WRITE    OUTPUT    TAPE    6,130     (  T  (  I  ) . XM ( I  ), YM (  I  )  , 
1  I     =    ItNIPLUSl) 

130    F0RMAT(2TX, 1HT, 1 8X , 2HXM, 20X , 2HYM , //(  1 7X, F8. 5 , 1  OX, 
1  F12.9, 10X,F12.9) ) 

GO    TO    160 
150    WRITE    OUTPUT    TAPE    6,1U0 

140    FORMAT(5X,31HDETERMINANT    OF    THE    MATRIX    ATOT     , 
1  11HEQUALS    ZERO///) 

WRITE    OUTPUT    TAPE    6 , 1 35, XTOT , YTOT, U,  V,ATOT(  1 . 1 ) , 
1  ATOT(  1  ,2),  ATOTU,  1)  iATOT(2,2) 

135    F0RMAT(7HXT0T    »     , E 1 2 . 6 ,  1  OX . 7HYT0T    ■    . E 1 2 . 6/ 3X. UHU    -     , 

1  E12.6, 13X,UHV    =    , E12.6//1X.6HA11    =    .E12.6, 

2  11X.6HA12    =    ,E12.6/1X,6HA21    "     ,E12.6,11X, 

3  6HA22    =    ,E12.6/) 

27. 


c 
c 

c 
c 
c 


160  CALL  TIME(6) 

WRITE  OUTPUT  TAPE  6*  2U0 
2U0  FORMAT( 1  Hi ) 

GO  TO  2 

READ  DATA  FOR  ANOTHER  PROBLEM 

END 


SUBROUTINE  SOLVE { Al 1 , A  1 2 , A2 1 , A22 , Bl,  B2, X 1 ,X2 , IND ) 

SOLVES  THE  MATRIX  AX=B  FOR  X 

D=A1 1»A22-A12«A21 

IF(D)     1,12.1 

Xl=A22/D»Bl-Al2/D»B2 

X2  =  -A21/D*BUA11/D*B2 

IND=1 

RETURN 

IND=2  ': 

X1=0. 

X2  =  0. 

RETURN 

END 

END 
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